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CHAPTER  1 


BACKGROUND 


Introducti on 

The  effect  of  high  technology  on  modern  weapons  systems 
is  monumental.  For  the  United  States  Air  Force  (USAF)  it 
has  meant  unparalleled  advancements  in  aircraft  systems 
capability  over  a  relatively  short  time.  "Fighter  aircraft 
are  dependent  upon  sophisticated  fire  control,  weapons 
delivery,  navigation,  and  display  systems  to  provide  pilots 
with  the  capacity  to  accomplish  their  missions  [5:1-1]." 

With  these  advancements  comes  the  problem  of  how  to  maintain 
these  systems.  Technology  has  outdistanced  the  technician's 
ability  to  cope  with  the  problems  and  complexities  of  new 
systems.  Given  the  complexity  of  the  F - 1 6  radar,  for 
example,  it  is  not  surprising  it  could  fail  in  a  number  of 
ways.  Looking  just  at  simple  single  report  failures,  the 
General  Dynamics  pocket  reference  (block  10  Avionics  Fault 
Analysis  Card)  lists  157  ways  in  which  the  radar  could  fail 
(5:5-4, 5-5).  The  technician  can  no  longer  rely  on  accom¬ 
plishing  the  job  via  cognitive  abilities,  simple  tools, 
checklists,  and  technical  data.  Realizing  this  dilemma, 
engineers  have  sought  to  simplify  systems  fault  isolation  by 
designing  special  test  equipment  to  aid  the  technician. 
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Modern  aircraft  design  incorporates  built-in-test 
equipment  (BITE)  and  automatic  test  equipment  (ATE)  to 
increase  maintenance  effectiveness  and  permit  the  use  of 
lower  skilled  personnel  (2:3).  The  F - 1 6  avionic  subsystems 
were  required  by  the  acquisition  contracts  to  provide  95 
percent  failure  detection  and  95  percent  fault  isolation  at 
the  organizational  maintenance  level,  with  maintenance  per¬ 
sonnel  troubleshooting  the  remaining  failures  (5:1-2).  In 
many  cases,  the  organizational  level  of  maintenance  cannot 
duplicate  (CND)  the  problem  or  it  removes  equipment  that 
subsequently  retests-ok  (RTOK)  at  the  intermediate  level  of 
maintenance.  Good  units  removed  in  error  may  be  used  again 
after  being  RTOKed,  but  while  they  are  in  the  intermediate 
maintenance  shop  they  are  not  available  for  re-issue. 
Temporary  shortages  result,  affecting  stock  leveis  and  often 
reducing  aircraft  availability  (14:15).  These  maintenance 
errors  reduce  operational  readiness  and  degrade  the  logistics 
support  system.  The  Air  Force  must  increase  the  effective¬ 
ness  of  maintenance  organizations  by  reducing  CND  and  RTOK 
occurrences.  Effective  maintenance  organizations  can  reduce 
CND  and  RTOK  rates  and  increase  their  unit’s  operational 
readi ness . 

The  initial  costs  of  acquisition  of  new  high  technology 
weapons  systems  are  high.  So,  too,  are  the  costs  of  the 
maintenance  support  required  over  their  life  to  maintain 
operational  readiness.  Approximately  one  third  of  the  total 
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cost  of  new  weapons  and  equipment  is  expended  for  electronics 
(12:38).  Maintenance  costs  for  the  life  cycle  of  a  new  sys¬ 
tem  can  only  be  estimated  during  acquisition  but  are  measur¬ 
able  for  systems  in  the  field. 

One  cost  of  ineffective  maintenance  is  lowered  opera¬ 
tional  readiness  (OR)  rates.  Aircraft  not  OR  have  lost  their 
utility  value  for  the  time  they  are  out  for  maintenance 
(6:15).  The  United  States  Navy,  for  example,  is  experiencing 
52  to  58  percent  operational  readiness  for  F-14A  aircraft 
(6:13);  while  the  USAF  is  experiencing  approximately  53  per¬ 
cent  for  daily  sortie  requests  exceeding  five  aircraft  (9:14). 
The  cost  to  the  Navy,  based  on  aircraft  acquisition  cost,  of 
F - 1 4  aircraft  not  OR,  using  a  48  percent  not  OR  rate  and  $21 
million  per  aircraft,  is  approximately  SI. 5  billion  (6:15). 
"Experts  indicate  that  other  weapons  systems  are  experiencing 
the  same  or  even  lower  operational  readiness  [6:13]."  This 
is  a  drastic  reduction  in  readiness  compared  to  the  80  per¬ 
cent  expected  and  achieved  with  weapons  systems  a  few  decades 
ago  (6:14). 

Maintenance  Errors 

A  major  contributor  to  the  low  operational  readiness  is 
the  maintenance  technician.  "He  is  performing  well  below 
his  natural  potential  [6:16]."  The  use  of  BITE  and  ATE 
fault  isolation  capability  would  make  the  flight  line  job 
routine  if  the  system  provided  unambiguous  indications  of 
failure.  BITE  detects  failure,  signals  the  pilot  or 
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technician  of  a  fault,  and  isolates  the  fault  to  a  defective 
line  replacement  unit  (LRU).  Then,  in  the  ideal  situation, 
the  technician  removes  the  defective  LRU,  installs  a  ser¬ 
viceable  one,  and  sends  the  defective  LRU  to  the  avionics 
intermediate  shop  (AIS)  for  repair  (5:1-1).  Such  is  not  the 
case  in  reality.  The  indicators  are  often  unreliable  and 
malfunctions  may  occur  in  several  systems  at  once  or  affect 
the  performance  of  totally  different  systems  ( 1 3  :  v  i ) .  The 
technician  must  deal  with  incomplete  provisions  for  fault 
detection  or  excessive  demand  for  reasoning  on  his  part 
(2:37).  Failure  of  the  technician  to  understand  the  inter¬ 
relationships  of  system  components  results  in  increased  CND 
and  RTOK  and  decreased  maintenance  effectiveness. 

Past  evaluation  of  maintenance  effectiveness  used  time- 
related  standards  to  measure  maintenance  performance  against 
other  organizations  with  like  weapons  systems.  The  3-M  Com¬ 
pany  developed  a  measure  using  three  types  of  errors:  Type  I, 
Type  II,  and  Type  d  (6:16). 

"Type  I  error  occurs  when  a  good  unit  is  removed 
erroneously  [6:16]."  This  usually  occurs  when  a  technician 
cannot  duplicate  the  problem  and  changes  a  unit  for  the  sake 
of  clearing  a  write-up. 

"Type  II  error  occurs  when  a  bad  or  malfunctioning  unit 
is  not  found,  which  often  results  in  the  wrong  thing  being 
repaired  [6:16]."  The  technician  clears  the  write-up  with  a 
CND  record  entry  or  a  repair  which  results  in  a  repeat 
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write-up.  Recent  studies  indicate  that  of  all  avionics 
equipment  removed  from  aircraft,  about  30  percent  pass  the 
retesting  procedures  at  the  intermediate  level  of  mainte¬ 
nance  (14:1-1). 

"Type  d  error  occurs  when  the  maintenance  activity  pro¬ 
duces  damage  or  malfunctions  in  the  system  [6:16]."  The 
technician  damages  a  component,  i.e.  breaks  a  cannon  plug, 
shorts  a  circuit  board,  or  causes  other  damage  in  the  pro¬ 
cess  of  troubleshooting.  All  three  of  these  errors  can  be 
related  to  CND,  RTOK,  and  the  design  of  the  system. 

A  related  problem  of  flight  crew  interface  adds  to 
maintenance  errors.  "Debriefings  by  knowledgable  senior 
maintenance  technicians  will  eliminate  unnecessary  write-ups 
and  provide  maintenance  with  good  descriptive  failure  write¬ 
ups  [18:4.2.6]."  "The  accuracy  of  debriefing  write-ups  is 
directly  proportional  to  the  comprehen s i on  of  the  debriefers 
[14:18]."  Although  the  selection  of  debriefing  personnel 
from  the  units  is  made  with  some  knowledge  of  their  past 
technical  performance,  the  overall  selection  process  is 
random  relative  to  their  performance  as  debriefers.  The 
experimenter  assumes  as  a  result  of  this  randomness  that 
this  problem  will  have  little  or  no  effect  on  maintenance 
errors . 

"Maintenance  production  is  set  up  to  facilitate  manage¬ 
ment  of  resources  and  to  promote  effectiveness,  deploy¬ 
ability,  and  economy.  It  is  divided  into  two  categories, 
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on-equipment  and  of f-equi pment  [16:2]."  On-equipment 
maintenance  is  performed  by  the  organizational  level  of 
maintenance  and  of f-equ i pment  by  the  intermediate  level  of 
maintenance. 

Maintenance  performance  at  the  organizational  level  is 
influenced  by  the  nature  of  the  aircraft,  BITE  and  ATE 
design,  and  the  interplay  of  its  support  elements  (6:30). 
Maintenance  effectiveness  of  accessing  system  status  and 
correcting  and  preserving  the  system  can  be  measured  by 
Type  I,  II,  and  d  error  rate.  System  design  should  promote 
the  reduction  of  errors  and  the  time  invested  by  maintenance 
to  make  a  repair  (6:30).  System  design  factors  that  affect 
maintenance  are:  (1)  assessment  of  system  status;  and  (2) 
correction  or  preservation  of  system  condition. 

System  status  can  be  assessed  with  symptoms  and  cues. 
"Symptoms  are  system  outputs  that  fall  beyond  allowable 
operating  limits.  Cues  are  bits  of  information  concerning 
the  relationships  among  the  constituent  parts  of  the  system 
[6:35]."  The  technician  uses  cues  to  identify  the  failed 
components  of  the  system. 

Natural  cues  are  the  easiest  to  observe  because  they 
follow  mechanical  principles  the  technican  can  easily  under¬ 
stand.  Technicians  identify  the  failure  by  simple  examina¬ 
tion  for  wear,  misalignment,  or  broken  parts  (6:35).  Beyond 
the  simple  natural  cues  are  comp  lex,  or  process,  cues. 


Process  cues  are  used  where  the  processes  are  not 
easily  observed,  as  in  electronic  or  hydraulic  control 
systems.  Process  cues  are  instrumented  readings,  computer 
readouts,  BITE  and/or  ATE  results,  or  other  indications  of 
the  final  action  of  a  system  or  its  subsystems  (6:35).  Well 
designed  process  cues  accurately  depict  the  actual  final 
results  of  the  system's  process  as  well  as  critical  inter¬ 
mediate  steps. 

Military  Standard,  MI L - STD-  1 4 72C ,  "Human  Engineering 
Design  Criteria  for  Military  Systems,  Equipment,  and 
Facilities",  provides  guidance  for  design  maintainability 
through  physical  access,  action  accuracy,  and  action  ease. 

The  objective  is  to  provide  easy  access  on  a  hierarchical 
order  to  units  requiring  repair  with  critical  high  failure 
rate  items  the  most  accessible  (15:5.9.4.5).  Noncritical 
components  will  be  given  priority  by  frequency  of  maintenance 
actions  (15:5.9.4.5).  Additionally,  common  hand  tools  and 
simple  handling  equipment  should  be  enough  to  perform  most 
maintenance  actions  (15:5.9.4.6).  Alignment  pins  and  coding 
of  parts  aid  assembling  parts  and  insure  use  of  correct 
parts  (15:5.9.12.4-5).  Physical  access  and  action  accuracy 
are  brought  together  with  action  ease  where  the  technician’s 
skill  level  is  related  to  the  task  he  must  perform 
(15:5.9.4.7).  "The  relative  degree  of  action  ease  built 
into  the  hardware  may  influence  both  Type  d  error  rate  and 
maintenance  time  [6:39]," 
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Logistics  support  for  maintenance  involves  facilities, 
equipment,  spares,  manning,  technical  information,  and  main¬ 
tenance  management  (6:40).  Melaragno's  (9:43)  USAF  F - 1 5 
study  shows  adequate  logistics  support  exists  for  all  but 
avionics  systems  and  spares  for  avionics  intermediate  level 
shop  (AIS)  test  equi pment .  Insufficient  spare  avionic  LRUs 
has  restricted  the  combat  capability  of  the  F - 1 5  severely. 
Spare  parts  for  the  AIS  test  stations  are  also  critical  and 
in  short  supply  (9:48).  Lack  of  F - 1 6  spares  inventory  was  a 
major  reason  cited  for  cannibilization  actions  and  had  signi¬ 
ficant  impact  on  how  diagnosis  is  practiced  (5:5-43). 

Intermediate  level  maintenance  diagnosis  is  accomplished 
on  the  AIS  test  station,  a  complex  tester  used  to  test 
avionic  components  for  the  F-I6  aircraft.  The  tester  com¬ 
pares  the  actual  performance  of  the  component,  in  the  shop 
environment,  against  specific  preset  parameters  that  the 
system  is  designed  to  operate  within.  A  hard  copy  printout 
is  made  by  the  test  station  identifying  the  fault  or  faults 
of  the  components.  This  printout  is  forwarded  with  the  LRU 
when  it  is  returned  to  depot  for  repairs  beyond  the  base 
level  capabi 1 i ty . 

Compounding  the  spares  shortage  is  the  effect  of  CND 
and  RTOK.  Maintenance  organizations  may  become  ineffective 
because  of  repair  time,  equipment,  and  supplies  to  test  and 
repair  components  generated  by  CND  and  RTOK  (6:26).  The 
false  demands  cause  artificially  high  supply  stock  levels 
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by  increasing  the  quantity  required  to  cover  repair  cycle 
time  (7).  These  repair  cycle  demands,  along  with  other 
maintenance  demands  that  create  artificial  requirements,  are 
intensified  by  CND/RTOK  occurrences  and  increase  the  costs 
of  logistics  support  and  degrade  operational  readiness. 

The  reported  CND  and  RTOK  rates  imply  that  significant 
logistics  support  is  expended  in  troubleshooting,  removing, 
retesting,  and  replacing  serviceable  avionics  components 
thereby  reducing  aircraft  availability  and  increasing  total 
support  costs  (2:3).  The  real  flexibility  to  increase 
operational  readiness  resides  in  identifying  and  reducing 
the  errors  of  maintenance  personnel  in  accessing  system 
failures  (6:56). 

Problem  Statement 

The  area  of  CND  and  RTOK  has  been  identified  by  recent 
research  as  a  significant  contributor  to  the  decline  in  OR 
rates  (2:3).  Reducing  CND  and  RTOK  will  increase  OR  rates 
and  decrease  the  life  cycle  costs  of  a  system.  This  study 
focused  on  the  aircraft  maintenance  problems  of  CND  and 
RTOK.  There  is  a  definite  need  for  an  analytical  method  for 
determining  causes  of  CND  and  RTOK  occurrences  and  an 
evaluation  of  those  causes  leading  to  usable  solutions. 

Research  Objectives 


The  objective  of  this  research  was  to  explore  stra¬ 
tegies  for  isolating  reasons  for  CND  and  RTOK  occurrences 


using  the  existing  USAF  maintenance  data  collection  ( M DC ) 
system.  Where  differences  between  CND  and  RTQK  rates  exist 
among  organizations  with  like  weapons  systems  there  are 
opportun i t i es  for  isolating  or  inferring  cause.  The  follow¬ 
ing  hypotheses  will  be  used  to  determine  if  statistical 
differences  exist. 

Research  Hypotheses 

1.  Maintenance  CND  and  RTOK  occurrence  statistics  are 
not  significantly  different  from  wing  to  wing. 

2.  Test  station  RTOK  occurrence  are  not  signif icantly 
different  from  test  station  to  test  station  among  the  bases 
sampl ed . 

3.  CND  rates  for  avionic  systems  are  not  significantly 
different  from  aircraft  to  aircraft  within  a  model  design 
series  (MDS). 

4.  The  number  of  days  between  a  CND  or  RTOK  occurrence 
and  the  next  maintenance  action  will  be  exponentially 
distributed  with  higher  infant  failures  that  reduce  to 
chance  failures  over  time. 
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CHAPTER  2 


RESEARCH  METHODOLOGY 


Introduction 

Many  aspects  of  maintenance  performance  are  used  to 
quantify  and  analyze  the  maintenance  process  in  an  attempt 
to  improve  maintenance  effectiveness  and  operational  readi¬ 
ness.  Two  aspects,  CNO  and  RTOK,  continue  to  plague  the 
maintenance  technician  yet  have  historically  received  little 
formal  study.  However,  significant  research  resources  are 
now  being  devoted  to  identify  the  causes  of  high  RTOK  and 
CND  rates  (2:3).  The  research  reported  here  explored 
strategies  for  isolating  reasons  for  high  CND/RTOK  by 
evaluating  the  statistical  differences  hypothesized  in 
Chapter  One. 

Target  Population 

The  USAF  active  inventory  aircraft  are  identified  by 
mission  design  series  (MDS).  Some  examples  are,  A-7,  A-10, 
A-37  ,  B - 52 ,  C - 1 41 ,  F-15,  F-16,  FB-111,  RF-4,  RF-111,  and 
other  attack,  bomber,  cargo,  cargo  tanker,  fighter,  heli¬ 
copter,  reconnaissance,  and  trainer  aircraft.  Nearly  all 
USAF  MDS  incorporate  radar,  inertial  navigation,  doppler 
navigation,  communication,  or  other  avionic  systems  which 
use  BITE  or  ATE  to  enhance  maintenance  effectiveness.  The 
F-16  aircraft  was  chosen  as  the  research  sample  because: 
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--  the  F - 1 6  has  both  BITE  and  ATE  incorporated  in  its 
maintenance  support  package. 

--  of  the  high  degree  of  attention  placed  on  accurate 
data  gathering  relative  to  maintenance  effectiveness. 

--  the  Air  Force  Specialty  Code  (AFSC)  support  is 

representative  of  AFSCs  used  to  support  other  air¬ 
craft  with  similar  systems. 

--  it  has  good  climate/geographical  representation: 

Hill  AFB:  extremes  of  hot  and  cold,  high/dry  desert; 
MacDill  AFB:  hot,  humid,  salt  exposure,  sea  coast; 
Nellis  AFB:  hot,  dry  desert- 

Data  Collection 

The  planning  for  and  collection  of  useful  data  is  recog¬ 
nized  as  a  vital  aspect  in  analyzing  maintenance  effective¬ 
ness.  With  the  goal  of  improving  the  information  and 
communications  for  the  management  of  the  F-16  program,  the 
procurement  of  the  F-16  centralized  data  system  (CDS) 
became  necessary  (1:29-30).  The  CDS  program  focuses  on  the 
crucial  automatic  test  equipments  which  have  been  the  source 
of  technical  and  managerial  concern  on  earlier  aircraft 
development  programs  (3:1-3).  The  CDS,  along  with  the 
maintenance  data  collection  system  (MDC),  was  used  to 
collect  data  into  a  master  file  containing;  base,  workcenter, 
job  control  number,  aircraft  identification  number,  work  unit 
code,  employee  number,  Air  Force  Specialty  Code  (AFSC),  type 
maintenance,  action  taken,  when  discovered,  how  malfunction, 
system  hours,  and  test  station  number.  The  master  file  was 
reduced  as  needed  for  analysis.  These  files  form  the  sample 
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populations  for  the  analyses  to  answer  the  hypotheses  stated 
in  Chapter  One. 

The  research  was  designed  to  compare  the  performance  of 
avionics  maintenance  organizations  in  the  three  sample  wings 
using  data  relative  to  on-equipment  versus  of f-equi pment 
maintenance,  aircraft  serial  number,  and  the  length  of  time 
a  CND  or  RTOK  repair  action  lasts  before  another  maintenance 
action  is  required. 

Data  Analysis 

The  time  period  of  1  April  1981  to  31  March  1982  was 
used  as  a  matter  of  convenience.  It  was  assumed  that  the 
data,  though  historical,  contains  random  occurrences  of  CND 
and  RTOK.  The  Cyber  computer,  using  the  statistical  package 
for  social  sciences  (SPSS),  was  used  to  do  a  frequency 
analysis  of  the  master  file  to  determine  which  avionics 
system  work  unit  codes  (WUC)  were  greater  than  or  equal  to 
10  percent  of  the  total  avionic  system  malfunctions.  Those 
WUCs  which  fit  this  criteria  went  through  a  frequency 
analysis  to  determine  if  the  combined  CND  and  RTOK  occur¬ 
rences  were  greater  than  or  equal  to  10  percent  of  the 
malfunctions  by  using  definitive  malfunction  codes  (799  -  no 
defect;  948  -  operator  error/no  defect).  These  same  malfunc¬ 
tion  codes  were  used  to  convert  the  files  to  a  binomial 
coding  of  799  or  NOT  (not  799).  The  files  served  as  the 
sample  populations  for  hypothesis  number  one.  To  accomodate 
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hypothesis  number  two,  all  on-equipment  and  other  "not  bench 
tested"  actions  were  removed  from  the  files.  The  files  were 
then  ready  for  contingency  table  analysis. 

To  perform  a  contingency  table  analysis,  it  was  assumed 
that  independent  random  samples  of  size  n^,  n^,  ...  nc  is 
large  (10:438-39).  Since  CND  and  RTOK  efforts  are  separated 
by  job  control  numbers,  and  repeat  write-ups  are  treated  as 
a  new  job,  it  is  assumed  all  CND  and  RTOK  occurrences  are 
unique.  The  sampling  method  and  assumptions  lead  to  testing 
comparisons  of  several  multinomial  populations  which  is  some¬ 
times  called  a  test  of  homogeneity  (10:441). 

2 

The  Chi-Square  (x  )  statistic  was  used  to  test  for 
significant  differences  in  CND  and  RTOK  for  hypotheses  one 
and  two.  This  compared  the  observed  frequency  of  specific 
occurrences  with  the  number  of  occurrences  expected, 
assuming  the  distribution  of  CND  and  RTOK  rates  were  equiva¬ 
lent.  It  further  provided  a  measure  for  determining  if 
chance  variation  could  explain  away  the  difference  between 
the  observed  and  expected  frequencies. 

First,  the  contingency  and  probability  tables  were 

developed  for  each  hypothesis.  Then  the  expected,  or  mean 
2 

(X  ),  count  in  each  cell  was  calculated  assuming  the  null 
hypothesis  of  homogeneity  of  the  samples.  The  observed  and 

expected  (estimated)  counts  in  each  cell  were  compared  using 

2  2 
the  X  statistics.  Large  values  of  X  indicate  that  the 

observed  and  expected  counts  do  not  agree  and,  therefore. 
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the  samples  would  not  be  homogeneous.  Since  the  X  sampling 

2 

distribution  is  approximately  x  distributed  it  can  be  used 

2 

to  determine  how  large  X  must  be  before  it  is  too  large  to 

2 

be  attributed  to  chance.  The  degree  of  freedom  from  ;<  is 
(r-l)(c-l)  where  r  is  the  number  of  rows  and  c  is  the  number 
of  columns  of  the  contingency  table  731-34)  . 

The  observed  count  in  the  cell  is  denoted  by  n .  . ,  with 

*  J 

the  i  the  row  total  being  r^ ,  the  j  column  total  e ^  and  the 
sample  size  is  n.  The  general  form  of  the  RXC  contingency 
t  a  b  1  e  i  s  : 


General  r  x  c 
Contingency  Table 


COLUMN 

TOTALS 


COLUMN 

1  2  ...  c 
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nll 

n  12 

... 

nic  | 

rl 

ROW  2 
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n2c  ! 

r2 

• 

; 

• 

• 

r 

nrl 

nr2 

nrc 

r 

r 

ROW 
TOTALS 


[8:734] 


The  general  form  of  the  table  analysis  is 


A  Test  of  an  Hypothesis  About  Multinomial  Probabilities 

V  P1  =  Pl,0’  P2  =  P2 . 0  ’  *•*’  Pk  =  Pk .  0  ’ 

where  p1  g,  ?2  g>  •••»  g  represent  the  hypothesized  values 
of  the  multinomial  probabilities 

H^:  At  least  one  of  the  multinomial  probabilities  does 
not  equal  its  hypothesized  value 
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r 


2  k  [n,  -  E(n  )  ] 2 

Test  statistic:  X  =  i  - r7-r — < - 

i =1 

where  E(n.)  =  np.  n,  the  expected  number  of  outcomes  of  type 

1  1  J  U 

i  assuming  Hq  is  true.  The  total  sample  size  is  n. 

2  2 

Rejection  region:  X  '>  xa  where  df  -  k  -  1 

Assumptions:  The  sample  size  n  will  be  large  enough  so  that, 
for  every  cell,  the  expected  cell  count,  E(n  ),  will  be  equal 
to  five  or  more.  [8:734] 

The  specific  contingency  tables  and  their  related  hypotheses 
used  in  this  study  are  located  in  Appendix  B. 

The  analysis  was  accomplished  using  the  statistical 
package  for  social  sciences  (SPSS)  on  the  Cyber  computer. 

The  SPSS  uses  a  program  of  cross  tabulation  and  measures  of 
association  to  accomplish  the  contingency  table  and  Chi- 
Square  statistical  operations.  Nornsis  provides  a  practical 
guide  to  accomplishing  the  procedure  (11:22-36). 

After  the  SPSS  analysis  was  completed,  the  results  were 
verified  by  entering  a  known  data  set  and  following  it 
through  a  complete  analysis.  This  test,  along  with  inspec¬ 
tion  and  manual  computation  of  some  of  the  observed  sample 
results,  verified  the  procedure. 

The  analysis  of  hypothesis  number  three  required 
developing  a  file  with  the  number  of  NOT  and  CND  occurrences 
for  each  aircraft.  The  SPSS  frequency  count  of  the  number 
of  aircraft  by  the  number  of  failures  should  produce  a  dis¬ 
tribution  whose  curve  approximates  a  Poisson  distribution. 
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The  Chi-Square  goodness  of  fit  test  rejects  or  cannot  reject 
the  fit  of  the  frequency  count  to  the  Poisson  distribution. 

If  the  frequency  count  is  not  Poisson  distributed  the  null 
hypothesis  must  be  rejected.  Two  assumptions  were  made  when 
doing  this  analysis:  (1)  all  the  aircraft  used  the  systems 
in  question  the  same  number  of  hours  and,  (2)  the  average 
failure  rate  (\)  was  the  same  for  all  the  aircraft. 

Hypothesis  number  four  required  building  a  file  from 
the  master  file  that  excluded  cannibalization  and  time  com¬ 
pliance  technical  order  (TCTO)  actions.  The  file  was  hand 
manipulated  to  extract  the  number  of  days  from  a  CND  or  RTOK 
to  the  next  repair  action,  adjusting  for  how  malfunction 
codes  P  and  Q  which  did  not  contribute  to  repair  actions. 

The  results  of  this  manipulation  were  entered  into  a  new  file 
and  graphed  using  the  SPSS  frequency  analysis.  The  result 
should  be  a  negative  exponential  curve  or  a  curve  that  begins 
as  a  negative  exponential  and  becomes  uniform  after  a  few 
days  of  data  points.  This  assumes  that  a  repaired  system 
will  mimic  a  new  system,  with  a  large  number  of  early  or 
infant  failures  and  with  failures  decreasing  to  a  relatively 
low  and  steady  rate  over  time  (18:20).  The  Chi-Square  good¬ 
ness  of  fit  test  rejects  or  cannot  reject  the  fit  of  the 
curve  to  the  hypothesized  distributions. 

Once  verified,  the  variables  were  compared  against  the 
hypotheses  stated  in  Chapter  One.  Where  no  significant 
statistical  differences  occur,  it  is  not  possible  to  draw 
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any  conclusions  other  than  the  populations  are  homogeneous 
for  the  particular  hypothesis.  Where  the  statistical  dif¬ 
ferences  are  significant,  inferences  were  explored  in  an 
effort  to  explain  the  differences  and/or  draw  conclusions. 

The  statistical  differences  were  evaluated  by  inter¬ 
viewing  knowledgeable  personnel  assigned  to  the  F- 16  System 
Program  Office  (SPO)  and  the  F - 1 6  wings  sampled.  This  effort 
attempted  to  isolate  variables  unknown  to  the  researcher  and 
explain  all  or  a  portion  of  the  differences.  Questions  were 
formulated  after  the  statistical  findings  were  completed  in 
order  to  insure  that  all  the  differences  from  the  stated 
hypotheses  were  addressed.  Informal,  semi -structured ,  open 
ended  intervi ews  were  conducted  directly  with  F - 1 6  SPO 
personnel  assigned  at  Wright-Patterson  AFB  and  by  telephone 
with  personnel  of  the  three  sample  wings.  Unexplained  or 
inadequately  explained  differences  were  identified  for 
further  research  beyond  the  scope  of  this  study. 
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CHAPTER  3 


FINDINGS 

The  method  of  data  reduction  described  in  Chapter  Two 
was  to  reduce  the  original  data  base  to  usable  files  of 
sample  populations  for  statistical  analysis.  The  frequency 
analysis  of  avionic  malfunctions  identified  three  WUCs 
(74A00,  74AA0,  and  74AB0)  as  being  greater  than  or  equal  to 
10  percent  of  the  total  avionic  malfunctions  listed  in  the 
data  base  with  25.9,  12.6  and  19.2  percent  respecti vely .  Of 
these  three  avionic  WUCs,  the  percentage  of  CND  and  RTOK 
occurrences  of  the  total  write-ups  for  each  WUC  is  54  percent 
for  74A00,  6.2  percent  for  74AAO,  and  12  percent  for  74AB0. 
Using  only  those  CND/RTOK  WUCs  greater  than  or  equal  to  10 
percent  ^educes  the  sample  population  to  WUC  74A00,  the  fire 
control  system;  and  WUC  74AB0,  the  radar  low  power  radio 
frequency  (LPRF)  LRU.  The  hypotheses  were  then  tested  for 
these  populations. 

Hypothesis  one;  WUC  74A00,  the  fire  control  system, 
included  only  CND  and  not  CND  results  because  the  malfunc¬ 
tions  were  internal  to  the  fire  control  system  and  system 
removal  for  bench  testing  is  not  possible.  The  null  hypo¬ 
thesis  that  the  CND  occurrences  are  not  significantly 
different  from  wing  to  wing  cannot  be  rejected.  A  raw  Chi- 
Square  (X^)  of  4.22712  is  less  than  the  of  5.99147  needed 
to  reject  the  null  with  a  probability  of  rejecting  the  null 
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if  in  fact  the  null  is  true  (a),  a  =  0.05.  See  Figure  1. 
74AB0  has  both  CND  and  RTOK  occurrences  because  the  LPRF  LRU 
can  be  tested  as  part  of  the  system  or  bench  tested  on  the 
AIS  test  station.  In  this  case,  the  CND  occurrences  were 

not  significantly  different  from  wing  to  wing  but  RTOK 

2  2 
occurrences  were.  The  X  for  CND  is  0.79555  while  X  for 

RTOK  is  21.76180  and  the  x^  for  both  is  5.99147.  See 

Figures  2  and  3. 

Hypothesis  two;  applies  to  74AB0,  the  LPRF  LRU,  since 

this  hypothesis  deals  with  only  the  AIS  test  stations.  The 

results  of  the  initial  contingency  table  include  all  work 

identified  to  specific  testers  as  well  as  work  accomplished 

on  the  AIS  test  stations  where  the  tester  identification 

number  was  not  included  in  the  data.  The  results  of  the 

analysis,  see  Figure  4,  reject  the  null  hypothesis  that  RTOK 

occurrences  are  not  significantly  different.  The  X  of 

69.23729  was  much  greater  than  the  x^  statistic  of  14.0671 

for  7  degrees  of  freedom  and  a  =  0.05.  Because  the  number 

of  maintenance  actions  on  AIS  test  stations  that  did  not 

identify  the  tester  was  large,  it  was  decided  to  repeat  the 

test  after  removing  the  unnumbered  tester  actions  from  the 

2 

file,  see  Figure  5.  This  resulted  in  a  X  value  of  26.15013, 

2 

greater  than  the  x  of  12.5916  for  6  degrees  of  freedom  and 
a  =  0.05.  Again  rejecting  the  null  hypothesis  and  concluding 
that  there  is  a  significant  difference  from  tester  to  tester. 
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Hypothesis  three;  using  a  failure  rate  (x)  of  x  =  1.783, 
the  resulting  curve,  see  Figure  6,  does  not  fit  the  Poisson 
distribution  because  of  the  large  number  of  aircraft  not 
experiencing  CND  and  RTOK  occurrences  (120  observed  compared 
to  an  expected  46.4),  a  full  43.5  percent  of  the  aircraft. 
This  is  further  confirmed  by  the  Chi-Square  goodness  of  fit 
test.  Therefore,  the  null  hypothesis  that  the  CND  and  RTOK 
occurrences  are  net  significantly  different,  must  be 
rejected  unless  more  adequate  information  is  available  to 
make  a  judgment. 

The  findings  for  hypothesis  four  show  129  CND  and  RTOK 
actions  on  the  LPRF  LRU  that  were  followed  by  repairs  other 
than  CND  or  RTOK  in  the  period  of  study.  The  WUC  74A00  file 
was  not  analyzed  because  effects  of  the  next  maintenance 
action  on  the  fire  control  system  could  not  be  clearly 
defined.  The  LPRF  LRU  cases  comprise  the  files  graphed  in 
Figure  7  to  show  the  number  of  days  between  CND  or  RTOK  and 
the  next  corrective  action,  in  one  day  increments.  Forty- 
five  percent  of  the  CND  and  RTOK  actions  result  in  repeat 
write-ups  on  the  same  day  they  were  signed  off  CND  or  RTOK 
(day  zero)  and  if  the  first  day  following  the  original  repair 
is  grouped  with  day  zero,  50.4  percent  of  the  CND  actions 
are  accounted  for.  Figure  8  shows  the  entire  file  recoded 
in  eight  increments  established  using  the  probability  of 
0.125  for  each  frequency  group.  The  Chi-Square  value  calcu¬ 
lated  from  the  data  is  197.1395,  compared  to  the  Chi-Square 
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test  statistic  of  12.592  for  a  =  0.05  and  6  degrees  of  free¬ 
dom.  ’Therefore,  the  curve  is  not  exponential  nor  does  it 
begin  as  an  exponential  distribution. 


CHAPTER  4 

SURVEY  QUESTIONS  AND  ANSWERS 

The  findings  of  Chapter  Three  open  the  following  ques¬ 
tions  that  are  relative  to  analyzing  the  findings  and  drawing 
conclusions  from  them.  These  questions  were  used  to  conduct 
informal  interfiews  to  gain  insights  into  differences  in  the 
hypotheses  and  the  findings. 

Hypothesis  One 

Preface  statement:  none 

Question  1:  What  is  the  mission  of  the  Wing? 

Responses : 

Hill  AFB:  Two  operations  squadrons  and  two  air 
crew  training  squadrons. 

MacDill  AFB:  To  provide  training  for  main¬ 
tenance  and  aircrew  personnel. 

Nellis  AFB:  Three  operational  squadrons. 
Question  2:  Are  there  significant  differences  in  mission 
requ i rements ,  from  the  other  sample  wings, 
that  could  affect  the  radar  low  power  radio 
frequency  LRU? 

Responses : 

Hill  AFB:  Training  squadrons  require  more  use 
of  LPRF  LRU  than  OPS  (operations) 
squadrons  and  generate  more  write¬ 
ups. 


23 


Mac D i 1 1  AFB:  No,  we  fly  the  same  U-rates  as 

the  other  wings  but  we're  not  manned 
the  same.  We're  manned  less  than 
the  OPS  squadrons  but  we  do  the 
same  job. 

Nellis  AFB:  No,  the  U-rate  is  the  same  as  the 
other  wings. 

Question  3 :  Were  the  avionic  line  and  shop  units  manned 
to  authorized  levels  during  the  period  of 
study,  April  1981  to  March  1982?  Were  the 
skill  level  authorizations  met? 

Responses : 

Hill  AFB:  We  experienced  a  change  from  75  per¬ 
cent  five  and  seven  (skill)  levels 
to  25  percent  five  and  seven  levels 
during  that  period.  The  quantity  of 
manning  met  the  authorized  levels. 
Hill  provided  tha  maintenance  cadre 
for  all  the  F - 1 6  units  being  formed. 
MacDill  AFB:  Unknown 

Nellis  AFB:  At  the  time  the  manning  was  con¬ 
stantly  changing  because  of  exces¬ 
sive  three  levels  and  cross¬ 
trainees. 

Question  4:  Were  there  any  critical  training  problems 
related  to  F - 1 6  fire  control  systems  at  the 
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wing's  organizational  or  intermediate  levels 
of  maintenance?  If  so,  what  were  they? 

Responses : 

Hill  AFB:  Yes,  there  was  an  imbalance  of 

grade  skills  to  do  maintenance  and 
training. 

MacDill  AFB:  No  known  training  problems,  but 
lack  of  corporate  knowledge  for  the 
study  period. 

Nellis  AFB:  Yes,  training  was  limited  because 
of  the  limited  number  of  five  and 
seven  levels. 


Hypothesis  Two 

Preface  statement:  There  are  statistical  differences  in 
the  results  from  AIS  test  stations  where  test  sta¬ 
tions  experience  different  RTOK  rates  within  the 
wing  and  between  the  sample  wings. 

Question  1:  In  what  condition  were  the  test  stations  in 
the  period  April  1981  to  March  1982?  Who 
maintained  them?  Who  maintains  them  now? 

Responses : 

Hill  AFB:  Good  condition.  Maintained  by  wing 
with  contractor  assistance  until 
January  1982.  Maintained  by  wing 
since  then. 
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MacDill  AFB:  Good  condition.  Maintained  by 
wing. 

Nellis  AFB:  Good  condition.  Maintained  by 
wing  with  contractor  assistance. 

[:  What  are  the  test  station  numbers  assigned 
your  AIS  now?  Are  they  the  same  testers  as 
were  assigned  during  the  study  period?  If 
not,  why  not? 

Hill  AFB:  I  don't  know  the  numbers  off  hand 
but  they  are  the  same  testers 
originally  assi gned . 

MacDill  AFB:  RF-15  and  RF-16  were  originally 
assigned  and  are  still  here. 

Nellis  AFB:  RF-10  and  RF-19  were  here  during 

that  time.  RF-33  came  in  last  fall. 
[:  Were  any  test  stations  given  preferential 
use?  If  so,  why? 

Hill  AFB:  No 

MacDill  AFB:  To  some  degree  yes.  RF-15  had 
higher  maintenance  and  parts  pro¬ 
blems.  During  a  two-shift  operation 
it  was  hard  to  get  to  boot-up  in  the 
morning,  but  the  problem  went  away 
when  it  started  on  a  three  shift 


operation. 
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Nellis  AFB :  No. 


Question  4:  How  frequently  were  calibrations  required 
for  AIS  test  stations?  How  frequently  are 
calibrations  required  now?  What  directive 
requires  the  calibration  and/or  establishes 
the  length  of  service  between  calibrations? 

Responses :  Components  of  the  test  stations  require 

different  frequencies  of  calibration.  1F-16A- 
37  gives  specific  directions  on  calibration. 

30  days  is  the  minimum  and  180  days  the  maxi¬ 
mum  for  the  components. 

Question  5:  How  much  (subjective)  adjustment,  if  any, 

is  required  to  maintain  the  parameters  during 
recal i brat i on? 

Responses : 

Hill  AFB:  No  significant  problems,  phase  two 
provisioning  for  test  equipment  has 
not  been  done. 

MacDill  AFB:  There  does  not  seem  to  be  a  pro¬ 
blem  to  calibrate  or  maintain  the 
parameters . 

Nellis  AFB:  Some  minor  problems,  but  they 

seem  to  hold  the  parameters  well. 


27 


Hypothesis  Three 

Preface  statement:  none 

Question  1:  Do  you  have  specific  aircraft  whose  fire 

control  systems  generate  more  LPRF  LRU  RTOKs 
than  others  in  the  wing?  If  so,  explain. 

Responses : 

Hill  AFB:  Yes,  because  of  the  age  of  block 
five  and  ten  aircraft. 

MacDill  AFB:  No.  Good  coordination  between 
organizational  and  intermediate 
maintenance  helps  keep  this  from 
happening . 

Nellis  AFB:  No,  although  it  has  been  looked 
into. 

Question  2:  If  yes  answer  to  question  one  above,  do 

maintenance  personnel  expend  additional  man 
hours  of  organizational  or  intermediate  main¬ 
tenance  on  these  aircraft  fire  control  sys¬ 
tems?  If  yes,  doing  what? 

Responses : 

Hill  AFB:  Yes,  because  as  the  failure  rate 

increases  the  cannibalization  rate 
increases.  Less  than  50  percent  of 
CANs  { canni bal i zati ons  )  are  reported. 
There  are  no  spares  so  if  we  deploy 
no  spares  for  WRS.  This  CAN  rate 
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increases  tne  frustration  level  and 


may  affect  retention  of  personnel. 
Questi on  3 :  Is  there  a  formal  or  informal  limit  on  the 
number  of  times  a  LPRF  LRU  and  RIOK  before  it 
is  returned  to  depot  for  further  analysis  and 
maintenance?  If  so,  what  is  the  limit?  How 
are  RTOKs  recorded  and  accounted  for  this 
purpose? 

Responses : 

Hill  AFB:  No,  there  is  no  bad  actor  program. 
MacDill  AFB:  No. 

Nellis  AFB:  No.  Keep  serial  numbers  of  LRUs 
and  track  them  through  the  CDS 
system . 


Hypothesis  Four 

Preface  statement:  none 

Question  1 :  Were  CND  and  RTOK  corrective  actions  given 
any  special  management  attention  during  the 
ucudy  period?  If  so,  what  were  they? 

Responses : 

Hill  AFB:  There  is  management  of  individual 
components  throig.'  deficiency 
analysis. 

MacDill  AFB:  Requires  a  seven  .evel  to  sign 
off  forms  on  all  CND  and  ROTKs . 
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Nellis  AFB:  Yes,  we  require  verification  of 
who  is  signing  it  off,  their  skill 
level,  and,  in  some  cases,  double 
testing  and  seven  level  sign  off. 

Question  2:  Were  there  any  formal  or  informal  policies 
related  to  CND  and  RTOK  corrective  actions 
during  the  study  period?  If  so,  what  were 
they?  Are  there  any  such  policies  now?  If 
so,  what  are  they? 

Responses: 

Hill  AFB:  There  is  a  MQI  (maintenance  operat¬ 
ing  instruction)  that  requires  that 
the  second  CND  be  signed  off  by  a 
seven  level,  the  same  as  repeat  or 
recurring  hard  failures.  This 
policy  has  been  expanded  along  with 
the  look  to  expanding  repair 
capability. 

MacDill  AFB:  AFR  66-5  requires  a  formal  policy 
for  CND  and  RTOKs.  A  seven  level 
has  to  sign  off  on  CND  and  RTOKs  and 
a  written  record  action  is  sent 
through  quality  assuance  for  review, 
then  to  analysis. 

Nellis  AFB:  We  have  a  local  MO  I  for  CND  and 
repeat  write-ups. 
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CHAPTER  5 


CONCLUSIONS  AND  RECOMMENDATIONS 


Introducti on 

This  research  explored  different  strategies  for  iso¬ 
lating  reasons  for  CND  and  RTOK  occurrences  by  analyzing  data 
that  currently  is  available  through  the  MDC  system.  Four 
hypotheses  were  subjected  to  statistical  testing  to  deter¬ 
mine  if  there  are  statistical  differences  between  CND  and 
RTOK  rates  using  historical  data  from  the  F - 1 6  CDS  system. 

Concl usion 

The  portion  of  hypothesis  one  dealing  with  CND  occur¬ 
rences  in  the  fire  control  system  (74A00)  and  the  LPRF  LRU 
(74AB0)  resulted  in  no  significant  differences.  Thetefore, 
it  is  not  possible  to  draw  any  conclusions  other  than  the 
populations  are  homogeneous.  There  were  statistical  dif¬ 
ferences  in  the  occurrences  of  RTOK  in  the  LPRF  LRU  between 
the  sample  wings.  When  these  differences  are  compared 
against  the  responses  to  the  survey  questions,  you  would 
expect  Nellis  AFB  to  have  the  lowest  CND  rate  because  there 
is  less  use  of  the  fire  control  systems,  where  it  is  used, 
the  pilots  would  have  more  experience  with  it.  Hill  AFB 
would  be  expected  to  be  the  median  and  MacDill  AFB  the 
highest.  In  fact,  Nellis  AFB  experienced  the  highest  CND 
rate,  followed  by  Hill  AFB  and  MacDill  AFB.  This  may  prove 
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a  fruitful  area  for  further  study.  However,  it  should  be 

recognized  that  contingency  table  analysis  with  the  Chi- 
2 

Square  versus  X  differences,  although  statistically  signi¬ 
ficant  for  this  data,  may  not  prove  valuable  as  a  procedure 
for  smaller  populations. 

The  RTOK  occurrences  were  broken  out  by  tester  identifi¬ 
cation  numbers  for  hypothesis  two.  The  difference  between 
not  RTOK  (NOT)  and  RTOK  is  significant  although  the  explana¬ 
tion  provided  by  MacDill  personnel  would  negate  differences 
between  their  own  testers.  Their  testers  performed  signifi¬ 
cantly  different  from  the  other  two  sample  wings,  however. 

This  may  be  attributed  to  the  age  of  the  aircraft  and  test 
equipment,  as  indicated  by  the  block  numbers  of  the  aircraft, 
or  any  number  of  other  possibilities.  These  differences  in 
RTOK  and  not  RTOK  offer  possible  avenues  for  further  research. 

The  rejection  of  the  null  hypothesis  for  hypothesis 
three  was  not  unexpected  by  the  researcher  but  was  contrary 
to  the  expectations  of  all  personnel  surveyed.  The  data  sup¬ 
ports  a  statistical  difference  in  the  CND/RTOK  rates  for 
specific  aircraft  by  serial  number.  In  reality,  aircraft  do 
perform  sporadically  with  periods  of  higher  instances  of 
failure  and  unexplained  malfunctions.  The  tail  of  the  curve 
supports  that,  over  time,  a  few  aircraft  will  exhibit  higher 
CND  rates  than  the  rest  of  the  fleet.  Predicting  which  air¬ 
craft,  out  of  the  fleet,  will  experience  the  high  CND/RTOK 
rates  is  not  possible  as  they  can  only  be  attributed  to 
chance. 


32 


Hypothesis  four  offers  little  opportunity  for  modeling 
because  it  fits  no  known  distributions  nor  could  it  be  fitted 
to  a  curve  that  would  be  useful  in  analyzing  other  data 
bases.  What  can  be  observed  is  the  high  incidences,  greater 
than  50  percent,  of  CND/RTOK  corrective  actions  that  prove 
to  be  ineffective.  This  indicates  that  the  organizations 
are  justified  in  expending  additional  man  hours  and  manage¬ 
ment  attention  on  CND  and  RTOK  corrective  actions.  Further, 
it  indicates  that  even  with  the  best  technicians  involved, 
there  is  only  a  50  percent  chance  of  being  right  when  using 
CND/RTOK  corrective  actions.  From  this,  it  can  be  concluded 
that  BITE  and  ATE  are  not  fulfilling  their  intended  purpose, 
either  as  a  result  of  design  shortcomings  or  failure  to  pro¬ 
vide  for  adequate  interpretation  of  test  outputs  for  main¬ 
tenance  personnel . 

About  the  Data  Base 

The  data  base  in  the  CDS  system  uses  the  same  collection 
design  as  the  MDC  system.  There  were  numerous  cases  where 
incorrect  data  was  evident,  i.e.  two  or  three  removal  actions 
for  a  LPRF  LRU  on  the  same  aircraft  over  a  two  month  period 
but  with  no  interim  installation  actions.  Some  aircraft  had 
more  than  one  LPRF  LRU  installed  without  an  interim  removal 
action.  Other  aircraft  had  LPRF  LRUs  RTOK  without  being 
removed  from  the  aircraft  or  subsequently  installed  in  the 
aircraft.  It  was  not  possible  to  insure  the  accur acy  of  all 
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the  data  in  the  files  analyzed  but  it  was  assumed  that  there 
were  no  affects  on  the  outcome  of  the  analyses. 

Other  cons i derat i ons  were  the  lack  of  subcategor i es  for 
WUCs,  how  malfunction  codes,  and  action  taken  codes  in  order 
to  better  account  for  actual  maintenance  actions  and  the 
effect  they  may  have  on  the  i nt erre 1  at i onsh i ps  between  com¬ 
ponents  of  the  system.  Additionally,  because  of  the  spares 
shortages,  LRUs  are  commonly  swapped  from  aircraft  to  air¬ 
craft  by  maintenance  personnel  attempting  to  do  fault 
diagnosis.  This  disrupts  the  system  and  in  many  cases  goes 
unreported  or  is  inappropriately  reported  do  to  lack  of 
subcategories . 

Recommendati ons 

The  following  recommendations  should  be  initiated  to 
further  the  Air  Force's  capability  to  identify  and  reduce 
sources  of  CND  and  RTOK  occurrences. 

1.  Further  analysis  of  the  statistical  differences 
between  test  stations. 

2.  Improve  BITE  and  ATE  interface  with  maintenance  per¬ 
sonnel  to  reduce  false  or  misinterpreted  test  indications. 

3.  Add  additional  WUCs  to  system  branches  and  compo¬ 
nents  to  reduce  the  number  of  system  write-ups  cleared  by 
using  general  system  WUCs. 

4.  Add  new  work  unit  codes  and  how  malfunction  codes 
to  account  for  system  intrusions  by  maintenance  personnel 
that  are  not  otherwise  accounted  for. 
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5.  Implement  bar  coding  components  with  WUC,  serial 
number,  part  number,  and  nomenclature  in  an  effort  to  reduce 
paperwork  for  maintenance  personnel  and  increase  record 
accuracy . 
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APPENDIX  A 
GLOSSARY 
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a  Probability  of  rejecting  H  if  in  fact  H  is 

true  (Type  I  error)  0  0 

AFSC  Air  Force  Speciality  Code 

AIS  Avionics  Intermedi tate  Shop 

ATE  Automatic  Test  Equipment 

BITE  Built-In  Test  Equipment 

c  Number  of  columns  in  a  contingency  table 

CDS  Computerized  Logistics  Decision  Support  Package 

CND  Cannot  Duplicate 

JCN  Job  Control  Number 

X  Mean  of  a  Poisson  Distribution 

LRU  Line  Replaceable  Unit 

LPRF  Low  Power  Radio  Frequency 

MDC  Maintenance  Data  Collection 

MDS  Mission  Design  Series 

n  Sample  Size 

OR  Operational  Readiness 

r  Number  of  rows  in  a  contingency  table 

RTOK  Retest-OK 

SPO  System  Program  Office 

SPSS  Statistical  Package  for  Social  Sciences 

USAF  United  States  Air  Force 

WUC  Work  Unit  Code 

2 

X  Mean  Square 

2 

x  Chi-Square  Statistic 
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APPENDIX  B 
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Hypothesis  #1  74AB0  CND 
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Hypothesis  #2  74AB0 

Tester  by  How  Malfunction 
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Fig.  5  Identified  Testers  Only 
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Hypothesis  #3 
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Fig.  6  Failures  per  Aircraft 


Hypothesis  #4 
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Hypothesis  #4 


Number  of 
Days  Be¬ 
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Fig.  8  Frequency  of  All  Days  Recoded 
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